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AMENDMENTS TO THE CLAIMS 

1 . (Currently Amended) A method of storing parameters of a deleted interpolation language 
model, the method comprising: 

obtaining a set of parameters for the deleted interpolation language model, 

wherein, the par ameters of the deleted inte r polation lang uage model allow 

an N-gram probability to be determined as a lin ear interpolation of a 

relative frequency est i mate for the N-gram and a probability for a lower 
order n-gram ; and 

storing at least one parameter for the deleted interpolation language model as a 
parameter for a backoff language model wherein, t he backoff language 
model replaces an N-gram p robability wi th a lower order n- gram, and a 

backoff we ight for any N-gr am that canno t be l ocated in the backoff 

l anguage mode l. 

2. (original) The method of claim 1 wherein storing at least one parameter for a deleted 
interpolation language model comprises storing a relative frequency of a sequence of words as a 
probability for a sequence of words in the backoff language model 

3. (original) The method of claim 2 wherein storing an interpolated probability comprises 
determining that a relative frequency for the sequence of words is greater than a threshold before 
storing the interpolated probability as a probability. 

4. (original) The method of claim 3 wherein storing a relative frequency comprises 
determining that the relative frequency is greater than a threshold before storing the relative 
frequency as a probability. 
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5. (original) The method of claim 2 wherein storing an interpolated probability comprises 
determining that the sequence of words forms a context for an n»gram in the backoff language 
model before storing the interpolated probability as a probability, 

6. (original) The method of claim 1 wherein storing at least one parameter for a deleted 
interpolation language model comprises storing an interpolation weight for the deleted 
interpolation model as a backoff weight for the backoff language model. 

7. (original) The method of claim 6 wherein storing the interpolation weight further comprises 
storing a sequence of words associated with the interpolation weight in a same entry as the 
interpolation weight. 

8. (original) The method of claim 1 wherein obtaining a set of parameters comprises training a 
set of interpolation weights, 

9. (original) The method of claim 8 wherein training a set of interpolation weights comprises 
training a separate weight for each of a set of frequency count ranges. 

10. (original) The method of claim 1 wherein storing at least one parameter for the deleted 
interpolation language model comprises storing the at least one parameter to produce a data 
structure that conforms to the ARPA format for backoff language models. 

11. (currently amended) A computer-readable storage medium having encoded there on 
computer-executable instructions for performing steps comprising: 

identifying a parameter for a deleted interpolation language model that forms 

p robabilities through interpolati ons of values; and 
placing the parameter in a data structure as a backoff parameter for a backoff 

language model that substitutes a weighted lo wer order n-g ram pro bability 
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for an N- gram probability when the N-gram. cannot be lo cat ed in the 
ba ckoff lang uag e model . 

12. (currently amended) The computer-readable st orage medium of claim 11 wherein 
placing the parameter in a data structure comprises determining that the parameter should be 
included as part of the backoff language model. 

13. (currently amended) The computer-readable st orage medium of claim 12 wherein 
determining that the parameter should be included as part of the backoff language model 
comprises determining that a frequency of a sequence of words in a training text exceeds a 
threshold. 

14. (currently amended) The computer-readable storage_medium of claim 12 wherein 
determining that the parameter should be included as part of the backoff language model 
comprises determining that a sequence of words associated with the parameter forms a context in 
an n-gram stored in the data structure. 

15. (currently amended) The computer-readable storage medium of claim 11 wherein 
placing a parameter in a data structure comprises placing a relative frequency as a probability for 
an n-gram, 

16. (currently amended) The computer-readable storage medium of claim 11 wherein 
placing a parameter in a data structure comprises placing an interpolation weight as a backoff 
weight for a context. 

17. (currently amended) The computer-readable storage medium of claim 11 wherein the 
data structure conforms to the ARPA standard for backoff language models. 

18. (original) A method for constructing a language model, the method comprising: 
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using deleted interpolation to train parameters for a language model; 
storing at least some of the trained parameters in a data structure conforming to 
the ARPA format for backoff language models. 

19, (original) The method of claim 18 wherein storing at least some of the trained parameters 
comprises storing parameters that are associated with sequences of words that appear in a 
training text more than a threshold amount, 

20, (original) The method of claim 18 wherein storing at least some of the trained parameters 
comprises storing parameters that are associated with sequences of words that appear as context 
words in an n~gram stored in the data structure. 



